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DESCRIPTION 

TOOTH IDENTIFICATION IN DIGITAL X-RAY IMAGES AND ASSIGNMENT 
OF INFORMATION TO DIGITAL X-RAY IMAGES 

5 

TECHNICAL FIELD 

The invention relates to a method of identifying objects, particularly teeth, in a digitized 
X-ray image and to a system for effecting same. The invention also relates to a method 
10 of assigning information to objects, particularly teeth, specified in a digitized X-ray im- 
age or a schematic diagram and to a system for effecting same. 

BACKGROUND OF THE INVENTION 

15 X-ray apparatus for making panoramic radiograms and individual images therefrom is 
disclosed in DE 3 545 509 (US 4,847,881) and DE 3 545 493 (US 4,813,060). Digital X- 
ray images for panoramic radiograms and cephalometric images are disclosed in EP 
0 632 994 (US 5,511,106). The production of digital intraoral images using an intraoral 
sensor is disclosed in EP 0 643 901 (US 5,513,252). The features disclosed in these 

2 0 documents are incorporated in this application by reference. 

Many diagnostic methods refer to individual details such as individual teeth, of which 
the existence, shape, and position differ individually. Diagnostics and documentation are 
hampered by the fact that the users are forced, when performing further actions, to resort 
2 5 not to individual but to general diagrams such as the standard tooth scheme on the health 
insurance certificate. 

When making automated series of radiograms is it necessary to previously inform the 
operating program as to which teeth are to be inspected. 

30 

The solution to this problem is at present either inadequate or complicated since it is 
only possibly to select either entire conventional fixed groups of teeth or only individual 
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teeth. In all cases the contact with reality is lost, since the user must leave his usual en- 
vironment, eg, a real dentition radiogram. 

Panoramic radiograms serve the purpose of quickly providing an overview of the general 
5 condition of the dentition. Such images can provide information without the need for 
other, eg, intraoral, X-ray images. However, these findings refer not to the entire image 
but to a specific displayed object, eg, a certain tooth. This thus gives rise to several find- 
ings referring to one image and to which, for example, the individual teeth are assigned. 
Acquisition thereof is complicated, because as a rule the user no longer has direct con- 
10 tact with his accustomed environment of a panoramic image. 

It is an object of the present invention to provide an individual tooth scheme and to as- 
sign information thereto. 

15 SUMMARY OF THE INVENTION 

This object is achieved by methods and systems as defined in the independent claims 
below. 

2 0 A particular solution is provided by a method of identifying objects, particularly teeth, in 
a digitized X-ray image. In order to afford maximum accuracy of recognition, the areas 
depicting the possible object(s) are specified by segmentation and/or edge detection of 
the X-ray image using image-processing algorithms and these areas are, for further 
specification, linked by computation to parameters of the X-ray apparatus used for mak- 

2 5 ing the X-ray image. 

The method can in addition be developed such that the apparatus-specific parameters are 
linked to parameters of a non-patient-related tooth data bank, in order to obtain probable 
actual geometrical positions over the areas depicting the possible object(s). Another pos- 

3 0 sibility is to carry out pooling (clustering) of recognized areas prior to linking to the ap- 

paratus-specific parameters. Furthermore, patient-specific parameters are additionally 
linked by computation for further specification of areas depicting the possible object(s). 
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These additional parameters are position data, trajectories, and starting and finishing 
points of the X-ray apparatus. The position data and trajectories can provide information 
on whether the tooth is a premolar or an incisor. In conjunction with statistical and sto- 
chastic data, the size of this tooth can be determined, by which means pattern recogni- 
5 tion is greatly simplified. Furthermore it is important to have information on the gray 
scales of the image. This information can lead to better recognition of edges. Thus it is 
possible to differentiate between flat tooth areas and other areas. 

Furthermore, computation can involve information concerning the patients. Information 
10 as to which teeth are no longer present or which teeth have been replace, make it possi- 
ble for the pattern recognition to use particularly elaborate recognition methods in these 
areas or, respectively, to carry out no pattern recognition. Furthermore anatomic patient 
characteristics may also be taken into account. Information concerning the race, age, 
sex, size, and weight can provide statistical conclusions on the jaw shape and the size 
15 and arrangement of the teeth. 

In the case of recognition errors, the user should have the possibility of interactively 
determining which areas are to be assigned to a tooth and which not. To this end, the 
user is presented with proposals on the recognized objects, which he can confirm or alter 
2 0 interactively. The user has the opportunity to determine the size of an object, for exam- 
ple by manually drawing in polygons. 

The gathered information on the objects is stored separately in a database. The informa- 
tion is preferably not directly integrated in the drawing. For reasons of efficiency it is 

2 5 preferred that the information on the objects be stored separately. In this way, the images 

can be used for other purposes without unwanted markings being visible in the image. 

The invention also relates to a system for the identification of objects, particularly teeth, 
in a digitized X-ray image. This system has input and output devices for interactive con- 

3 0 trol. These input and output devices are preferably a keyboard or pointing device and a 

display monitor. When correction is necessary, the pointing device can be used to spec- 
ify the individual areas that depict objects. 
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Another component of the system is a processing unit, which has access to the digitized 
X-ray image and to apparatus-specific information of the X-ray apparatus and which 
delimits the object in the digitized X-ray image on the basis of this information and also 
by segmentation and/or edge detection. This processing unit is preferably a known proc- 
5 essor capable of specifying the individual objects in the X-ray image on the basis of the 
aforementioned method. The procedure described in the method is carried out entirely by 
the processor. 

The processing unit can, in addition, have access to a non-patient-related tooth data bank 
10 and/or patient-specific information. The processing unit can also comprise means for 
clustering the areas existing after segmentation and/or edge detection. 

Thus means may be provided for submitting proposals to the user, which can be interac- 
tively accepted, rejected, or modified. 

15 

A computer interface to the X-ray apparatus makes it possible to access apparatus- 
specific data. These data preferably include position data, trajectories, starting and fin- 
ishing points, color scales, and/or color matchings of the X-ray apparatus, which can be 
included in the computation as already described above. 

20 

The anatomic patient characteristics such as race, age, sex, size, and weight are placed in 
a data bank. The system accesses this data bank and evaluates it in the manner already 
described according to preferably statistical data. Should information on the actual mass 
and sizes of teeth be present, this will naturally be preferably taken into account. 

25 

The system is preferably in the form of a PC and has a known serial, parallel, bus-type, 
or network interface connecting to the X-ray apparatus. The process running in this sys- 
tem is preferably controlled by software. A system as defined in any one or more of the 
preceding claims, characterized in that the system is a PC controlled by software. 

30 

Another component of the present invention is a system which assigns information to 
recognized objects. This system can be based on the aforementioned systems or meth- 
ods. However, the system may also be used separately if objects are already present. 
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This involves a system for the assignment of information to objects. These objects are 
preferably teeth specified in a digitized X-ray image. 

The system has input and output devices for interactive control of the system. These de- 
5 vices are preferably keyboards, pointing devices, and display monitors. The X-ray im- 
ages are filed in a first storage area. This is preferably a container for a large number of 
digitized X-ray images. Information labeling objects in the X-ray image are also filed in 
addition to these X-ray images. The object-labeling information is intended to determine 
the two-dimensional or, optionally, the three-dimensional size of the object in the image. 
10 Preferably, separate data structures are used which depict the object in the X-ray image 
by two-dimensional or multidimensional polygons. This information is laid over the 
original X-ray image during image build-up. However, it is conceivable that this infor- 
mation may be integrated in the X-ray image itself. 

15 In a second storage area, the information concerning the objects is stored. This informa- 
tion can be text information or image information. Thus it is conceivable that an image 
of a detail will be stored in higher resolution than additional information. Another possi- 
bility consists in providing an indication, by graphical marking, as to in what areas 
treatment is necessary or has already been carried out. It is likewise possibly to assign 

2 0 several types of information to an object. 

Furthermore, references between the objects and the information are stored. These refer- 
ences are preferably pointers or index fields which produce logical links between the 
objects and the information. 

25 

A processing unit controls the operations APPLY, DELETE, and ACCESS. The opera- 
tions are preferably initiated by the user with the aid of the input and output devices. 
Thus the processing unit controls access to the different storage areas. 

3 0 These storage areas are preferably only logically different storage areas. Physically, it 

can be a coherent storage area. 
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The use of a physical and logical storage area for the image information, the object in- 
formation and the additional information is possible but not particularly advantageous, 
since flexibility is lost. 

5 In order to improve working with the system, the objects are optically high-lighted on 
the output device. If selectable information should be present, this is characterized 
graphically by some other feature. 

The use of references makes a hierarchical arrangement of information possible. The 
10 user can thus move from a panoramic image to images of details and impart information 
at each level. 

A system is advantageous in which the references are in the form of links either directly 
on the object and/or directly on the information and/or are managed separately. 

15 

In a preferred embodiment, the system is a PC equipped with a display monitor, the in- 
formation being available via pop-up menus. These pop-up menus are shown in the form 
of pop-up windows appearing when an object is activated by the user. The pop-up menu 
enables the user to decide whether he would like to file new information or whether he 
2 0 wishes to view information already present. 

The further information preferably comprises diagnostic and/or treatment information 
and/or other X-ray images, particularly of details. 

2 5 In a preferred embodiment the system has a computer interface to an X-ray apparatus. 

Via this computer interface, information from the X-ray apparatus is transferred to the 
system in the form of X-ray images, which are saved to the first or third storage area. If 
the user has already specified an object from the outset, a reference to this object can 
likewise be immediately saved to the fourth storage area. The new X-ray image is im- 

3 o mediately assigned to an existing X-ray image or a selected partial area thereof and pro- 

vided with a corresponding reference. Thus a hierarchical arrangement is readily ob- 
tained and can optionally extend over several levels. 
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If no object should as yet have been specified, the system provides means permitting 
manual selection of a certain area in the X-ray image. 

The system preferably has the functionality of a data bank system. 

5 

Preferably, the objects are recognized by a system and method described above. A com- 
bination of systems is thus conceivable. 

Another feature of the present invention is a method of assigning information to objects, 
10 particularly teeth, which have been specified in a digitized X-ray image. In a first step, 
the digitized X-ray image is made. In a second step, the objects are manually or auto- 
matically specified. This step is only necessary, however, when the objects have not al- 
ready been specified. In a third step, the object is selected for which more information is 
to stored, fetched, or deleted. 

15 

Probably the most frequent operation is the interrogation operation for calling informa- 
tion from the data bank. A reference is followed which has been saved in relation to the 
object, which reference makes it possible to determine the information to be shown. 

2 0 In the case of a deleting operation, the reference is again followed which has been saved 
in relation to the object. This reference and any information are then deleted. Informa- 
tion is only deleted when it is referenced by only one object. It may happen that a num- 
ber of objects reference a single item of information. If, in such a case, the information 
were deleted, there would be no information for at least one object. In the case of a stor- 

2 5 age operation, an object is selected and the storage area for the information provided. 

Furthermore, a storage area for the reference is provided, so that the new information 
and the corresponding reference can be saved to these storage areas. 

It is likewise conceivable that, following specification of the object, digital images are 

3 0 received from the X-ray apparatus, which images are automatically assigned to the par- 

ticular object. In this case an adequate amount of storage space is allocated for accep- 
tance of the information. 
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In a preferred embodiment, the information is in the form of graphical tags which can be 
placed over the images as overlays. In this way it is possible to look at detailed informa- 
tion not visible in the images and to subsequently refine and edit the same. 

5 When objects are to be spread over other areas, the method offers the possibility of 
specifying areas of the objects in which information can be assigned. 

Access to information is preferably effected via pop-up menus which can be made to 
appear for each of the individual objects. 

10 

The processes are preferably controlled by means of software running on a known PC. 
Furthermore, a data medium may be provided which has a data structure which, follow- 
ing loading, carries a method as defined in one or more of the following method claims 
into effect. 

15 

Other advantageous embodiments are defined in the sub-claims. 



BRIEF DESCRIPTION OF THE DRAWINGS 



20 



A detailed description follows with reference to the drawings, in which: 



Fig. 1 



shows, diagrammatically, how teeth are specified; 



Fig. 2 



shows information which has been assigned to an object (tooth); 



25 



Figs. 3a, b show a pop-up menu for an object; 



Fig. 4 



shows a panoramic image depicting a recognized tooth. 



30 



Working example 



Fig. 1 shows diagrammatically what information from the X-ray apparatus and the pa- 
tient can be used following image recognition by edge detection and segmentation. If 
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edges and segments have been found, the attempt is made to group the recognized areas 
and edges by clustering. In order to identify the corresponding tooth, these groups are 
compared with tooth shapes of a non-patient-related data base while taking into consid- 
eration the instrument parameters, further processing then being carried out while taking 
5 into consideration the patient-dependent parameters. As a result, an X-ray image is 
shown which is specified and divided up by corresponding areas, ie objects. These areas 
stand for the recognized teeth. Such an area is shown in Figs. 2a, 2b. 

Fig. 2a shows a recognized tooth, for which information can be saved. The recognized 
10 tooth is depicted by an appropriate frame. 

In Fig. 2b, a group of teeth in the left half of the image has been selected by a mouse 
click, as a result of which their contours are shown high-lighted. They are teeth in the 
top row and the bottom row. Information can now be assigned to the teeth thus selected. 

15 If, however, too many teeth have been selected, for example, or if it is desired to shift 
the sensor position a little, or if some of the selected teeth are unimportant, since, al- 
though visible, they are not involved in the diagnosis, selection or deselection of one or 
more teeth may be effected, eg, by conventional mouse actions such as a single or dou- 
ble click, marking an area, etc. directly over the selected areas of the background image. 

20 In particular, it is necessary, in the case of a series of radiograms, to previously specify, 
in the operating program, the individual teeth to be inspected. 

Fig. 3 shows a possible mode of representation of information that has been assigned to 
objects. In the present case caries is involved. This information is always indicated when 

2 5 the mouse pointer is moved across the corresponding tooth. Other modes of representa- 

tion are also conceivable, however, particularly the use of small graphical symbols indi- 
cating that further information is available for this object. 

Figures 4a and 4b show a possible method of managing digital X-ray images. In this 

3 0 case a corresponding X-ray image is assigned to each tooth, wherever present. This as- 

signment can naturally only take effect when corresponding images are present. Figures 
4a and 4b show the possibility that the objects need not be restricted to an X-ray image 
but can alternatively be illustrated in a schematic diagram. 
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The method can be set down in the form of a software program as defined in any one or 
more of the following method claims. A data medium can contain a data structure that is 
capable of running on a computer to carry a method into effect such as is defined in one 
5 or more of the following method claims. 



